Uncovering the potential of evaluative conditioning in shaping attitudes toward sustainable product packaging.

Introduction: The necessity to promote pro-environmental behavior change in individuals and society is increasingly evident. This study aimed to investigate the effect of evaluative conditioning on consumers' perception of product packaging. Methods: We first produced two stimulus sets: one including images of supermarket products with different packaging and the other containing affective images of healthy nature (positive) and climate change impact (negative). These images were then paired in an evaluative conditioning experiment where respondents were informed about the impact of product packaging. Results: We found an effect of conditioning depending on the initial sustainability perception that participants had toward product packaging. Pairing products for which participants were uncertain about their sustainability with negative or positive affective images had a significant effect on the sustainable associations of the consumers in a negative or positive direction, respectively. However, the impact of conditioning on products that clearly had (un)sustainable packaging was not that strong. Discussion: These results provide new tools and evidence to further investigate the power of evaluative conditioning in pro-environmental attitude and behavior change.

Social robots as effective language tutors for children: empirical evidence from neuroscience.

The aim of the current study was to investigate children's brain responses to robot-assisted language learning. EEG brain signals were collected from 41 Japanese children who learned French vocabularies in two groups; half of the children learned new words from a social robot that narrated a story in French using animations on a computer screen (Robot group) and the other half watched the same animated story on the screen but only with a voiceover narration and without the robot (Display group). To examine brain activation during the learning phase, we extracted EEG functional connectivity (FC) which is defined as the rhythmic synchronization of signals recorded from different brain areas. The results indicated significantly higher global synchronization of brain signals in the theta frequency band in the Robot group during the learning phase. Closer inspection of intra-hemispheric and inter-hemispheric connections revealed that children who learned a new language from the robot experienced a stronger theta-band EEG synchronization in inter-hemispheric connections, which has been previously associated with success in second language learning in the neuroscientific literature. Additionally, using a multiple linear regression analysis, it was found that theta-band FC and group assignment were significant predictors of children's language learning with the Robot group scoring higher in the post-interaction word recognition test. These findings provide novel neuroscientific evidence for the effectiveness of social robots as second language tutors for children.

Classifying human emotions in HRI: applying global optimization model to EEG brain signals.

Significant efforts have been made in the past decade to humanize both the form and function of social robots to increase their acceptance among humans. To this end, social robots have recently been combined with brain-computer interface (BCI) systems in an attempt to give them an understanding of human mental states, particularly emotions. However, emotion recognition using BCIs poses several challenges, such as subjectivity of emotions, contextual dependency, and a lack of reliable neuro-metrics for real-time processing of emotions. Furthermore, the use of BCI systems introduces its own set of limitations, such as the bias-variance trade-off, dimensionality, and noise in the input data space. In this study, we sought to address some of these challenges by detecting human emotional states from EEG brain activity during human-robot interaction (HRI). EEG signals were collected from 10 participants who interacted with a Pepper robot that demonstrated either a positive or negative personality. Using emotion valence and arousal measures derived from frontal brain asymmetry (FBA), several machine learning models were trained to classify human's mental states in response to the robot personality. To improve classification accuracy, all proposed classifiers were subjected to a Global Optimization Model (GOM) based on feature selection and hyperparameter optimization techniques. The results showed that it is possible to classify a user's emotional responses to the robot's behavior from the EEG signals with an accuracy of up to 92%. The outcome of the current study contributes to the first level of the Theory of Mind (ToM) in Human-Robot Interaction, enabling robots to comprehend users' emotional responses and attribute mental states to them. Our work advances the field of social and assistive robotics by paving the way for the development of more empathetic and responsive HRI in the future.

Mother-child inter-brain synchrony during a mutual visual search task: A study of feedback valence and role.

Parent and child have been shown to synchronize their behaviors and physiology during social interactions. This synchrony is an important marker of their relationship quality and subsequently the child's social and emotional development. Therefore, understanding the factors that influence parent-child synchrony is an important undertaking. Using EEG hyperscanning, this study investigated brain-to-brain synchrony in mother-child dyads when they took turns performing a visual search task and received positive or negative feedback. In addition to the effect of feedback valence, we studied how their assigned role, i.e., observing or performing the task, influenced synchrony. Results revealed that mother-child synchrony was higher during positive feedback relative to negative feedback in delta and gamma frequency bands. Furthermore, a main effect was found for role in the alpha band with higher synchrony when a child observed their mother performing the task compared to when the mother observed their child. These findings reveal that a positive social context could lead a mother and child to synchronize more on a neural level, which could subsequently improve the quality of their relationship. This study provides insight into mechanisms that underlie mother-child brain-to-brain synchrony, and establishes a framework by which the impact of emotion and task demand on a dyad's synchrony can be investigated.

Corneal reflections and skin contrast yield better memory of human and virtual faces.

Virtual faces have been found to be rated less human-like and remembered worse than photographic images of humans. What it is in virtual faces that yields reduced memory has so far remained unclear. The current study investigated face memory in the context of virtual agent faces and human faces, real and manipulated, considering two factors of predicted influence, i.e., corneal reflections and skin contrast. Corneal reflections referred to the bright points in each eye that occur when the ambient light reflects from the surface of the cornea. Skin contrast referred to the degree to which skin surface is rough versus smooth. We conducted two memory experiments, one with high-quality virtual agent faces (Experiment 1) and the other with the photographs of human faces that were manipulated (Experiment 2). Experiment 1 showed better memory for virtual faces with increased corneal reflections and skin contrast (rougher rather than smoother skin). Experiment 2 replicated these findings, showing that removing the corneal reflections and smoothening the skin reduced memory recognition of manipulated faces, with a stronger effect exerted by the eyes than the skin. This study highlights specific features of the eyes and skin that can help explain memory discrepancies between real and virtual faces and in turn elucidates the factors that play a role in the cognitive processing of faces.

A framework for application of consumer neuroscience in pro-environmental behavior change interventions.

Most consumers are aware that climate change is a growing problem and admit that action is needed. However, research shows that consumers' behavior often does not conform to their value and orientations. This value-behavior gap is due to contextual factors such as price, product design, and social norms as well as individual factors such as personal and hedonic values, environmental beliefs, and the workload capacity an individual can handle. Because of this conflict of interest, consumers have a hard time identifying the true drivers of their behavior, as they are either unaware of or unwilling to acknowledge the processes at play. Therefore, consumer neuroscience methods might provide a valuable tool to uncover the implicit measurements of pro-environmental behavior (PEB). Several studies have already defined neurophysiological differences between green and non-green individuals; however, a behavior change intervention must be developed to motivate PEB among consumers. Motivating behavior with reward or punishment will most likely get users engaged in climate change action via brain structures related to the reward system, such as the amygdala, nucleus accumbens, and (pre)frontal cortex, where the reward information and subsequent affective responses are encoded. The intensity of the reward experience can be increased when the consumer is consciously considering the action to achieve it. This makes goal-directed behavior the potential aim of behavior change interventions. This article provides an extensive review of the neuroscientific evidence for consumer attitude, behavior, and decision-making processes in the light of sustainability incentives for behavior change interventions. Based on this review, we aim to unite the current theories and provide future research directions to exploit the power of affective conditioning and neuroscience methods for promoting PEB engagement.

Aviation and neurophysiology: A systematic review.

This paper systematically reviews 20 years of publications (N = 54) on aviation and neurophysiology. The main goal is to provide an account of neurophysiological changes associated with flight training with the aim of identifying neurometrics indicative of pilot's flight training level and task relevant mental states, as well as to capture the current state-of-art of (neuro)ergonomic design and practice in flight training. We identified multiple candidate neurometrics of training progress and workload, such as frontal theta power, the EEG Engagement Index and the Cognitive Stability Index. Furthermore, we discovered that several types of classifiers could be used to accurately detect mental states, such as the detection of drowsiness and mental fatigue. The paper advances practical guidelines on terminology usage, simulator fidelity, and multimodality, as well as future research ideas including the potential of Virtual Reality flight simulations for training, and a brain-computer interface for flight training.

Classification of motor imagery EEG using deep learning increases performance in inefficient BCI users.

Motor Imagery Brain-Computer Interfaces (MI-BCIs) are AI-driven systems that capture brain activity patterns associated with mental imagination of movement and convert them into commands for external devices. Traditionally, MI-BCIs operate on Machine Learning (ML) algorithms, which require extensive signal processing and feature engineering to extract changes in sensorimotor rhythms (SMR). In recent years, Deep Learning (DL) models have gained popularity for EEG classification as they provide a solution for automatic extraction of spatio-temporal features in the signals. However, past BCI studies that employed DL models, only attempted them with a small group of participants, without investigating the effectiveness of this approach for different user groups such as inefficient users. BCI inefficiency is a known and unsolved problem within BCI literature, generally defined as the inability of the user to produce the desired SMR patterns for the BCI classifier. In this study, we evaluated the effectiveness of DL models in capturing MI features particularly in the inefficient users. EEG signals from 54 subjects who performed a MI task of left- or right-hand grasp were recorded to compare the performance of two classification approaches; a ML approach vs. a DL approach. In the ML approach, Common Spatial Patterns (CSP) was used for feature extraction and then Linear Discriminant Analysis (LDA) model was employed for binary classification of the MI task. In the DL approach, a Convolutional Neural Network (CNN) model was constructed on the raw EEG signals. Additionally, subjects were divided into high vs. low performers based on their online BCI accuracy and the difference between the two classifiers' performance was compared between groups. Our results showed that the CNN model improved the classification accuracy for all subjects within the range of 2.37 to 28.28%, but more importantly, this improvement was significantly larger for low performers. Our findings show promise for employment of DL models on raw EEG signals in future MI-BCI systems, particularly for BCI inefficient users who are unable to produce desired sensorimotor patterns for conventional ML approaches.

Functional Connectivity Analysis in Motor-Imagery Brain Computer Interfaces.

Motor Imagery BCI systems have a high rate of users that are not capable of modulating their brain activity accurately enough to communicate with the system. Several studies have identified psychological, cognitive, and neurophysiological measures that might explain this MI-BCI inefficiency. Traditional research had focused on mu suppression in the sensorimotor area in order to classify imagery, but this does not reflect the true dynamics that underlie motor imagery. Functional connectivity reflects the interaction between brain regions during the MI task and resting-state network and is a promising tool in improving MI-BCI classification. In this study, 54 novice MI-BCI users were split into two groups based on their accuracy and their functional connectivity was compared in three network scales (Global, Large and Local scale) during the resting-state, left vs. right-hand motor imagery task, and the transition between the two phases. Our comparison of High and Low BCI performers showed that in the alpha band, functional connectivity in the right hemisphere was increased in High compared to Low aptitude MI-BCI users during motor imagery. These findings contribute to the existing literature that indeed connectivity might be a valuable feature in MI-BCI classification and in solving the MI-BCI inefficiency problem.

Vividness of Visual Imagery and Personality Impact Motor-Imagery Brain Computer Interfaces.

Brain-computer interfaces (BCIs) are communication bridges between a human brain and external world, enabling humans to interact with their environment without muscle intervention. Their functionality, therefore, depends on both the BCI system and the cognitive capacities of the user. Motor-imagery BCIs (MI-BCI) rely on the users' mental imagination of body movements. However, not all users have the ability to sufficiently modulate their brain activity for control of a MI-BCI; a problem known as BCI illiteracy or inefficiency. The underlying mechanism of this phenomenon and the cause of such difference among users is yet not fully understood. In this study, we investigated the impact of several cognitive and psychological measures on MI-BCI performance. Fifty-five novice BCI-users participated in a left- versus right-hand motor imagery task. In addition to their BCI classification error rate and demographics, psychological measures including personality factors, affinity for technology, and motivation during the experiment, as well as cognitive measures including visuospatial memory and spatial ability and Vividness of Visual Imagery were collected. Factors that were found to have a significant impact on MI-BCI performance were Vividness of Visual Imagery, and the personality factors of orderliness and autonomy. These findings shed light on individual traits that lead to difficulty in BCI operation and hence can help with early prediction of inefficiency among users to optimize training for them.

Exhausted parents in Japan: Preliminary validation of the Japanese version of the Parental Burnout Assessment.

We examined the factorial structure and validity of a Japanese version of the Parental Burnout Assessment, the PBA-J, with 1,500 Japanese parents. The Parental Burnout Assessment measures burnout using four dimensions: exhaustion in one's parental role, contrast in parental self, feelings of being fed up, and emotional distancing. Confirmatory factor analysis on the PBA-J supported a four-factor model. Multiple-group structural equation modeling with parent participants was supported for the factor-loading invariance model. Mothers had higher parental burnout scores than fathers. We found moderate-to-strong correlation coefficients between the PBA-J and the Parental Burnout Inventory (PBI-J; the comparative burnout measure), and weak-to-moderate correlation coefficients between the PBA-J and job burnout, neuroticism, co-parenting disagreement, and family disorganization. The PBA-J was correlated with parental perfectionism, particularly with concern over mistakes rather than sociodemographic variables. Overall, our findings provide initial evidence for the validity of the PBA-J.

Higher hypnotic suggestibility is associated with the lower EEG signal variability in theta, alpha, and beta frequency bands.

Variation of information in the firing rate of neural population, as reflected in different frequency bands of electroencephalographic (EEG) time series, provides direct evidence for change in neural responses of the brain to hypnotic suggestibility. However, realization of an effective biomarker for spiking behaviour of neural population proves to be an elusive subject matter with its impact evident in highly contrasting results in the literature. In this article, we took an information-theoretic stance on analysis of the EEG time series of the brain activity during hypnotic suggestions, thereby capturing the variability in pattern of brain neural activity in terms of its information content. For this purpose, we utilized differential entropy (DE, i.e., the average information content in a continuous time series) of theta, alpha, and beta frequency bands of fourteen-channel EEG time series recordings that pertain to the brain neural responses of twelve carefully selected high and low hypnotically suggestible individuals. Our results show that the higher hypnotic suggestibility is associated with a significantly lower variability in information content of theta, alpha, and beta frequencies. Moreover, they indicate that such a lower variability is accompanied by a significantly higher functional connectivity (FC, a measure of spatiotemporal synchronization) in the parietal and the parieto-occipital regions in the case of theta and alpha frequency bands and a non-significantly lower FC in the central region's beta frequency band. Our results contribute to the field in two ways. First, they identify the applicability of DE as a unifying measure to reproduce the similar observations that are separately reported through adaptation of different hypnotic biomarkers in the literature. Second, they extend these previous findings that were based on neutral hypnosis (i.e., a hypnotic procedure that involves no specific suggestions other than those for becoming hypnotized) to the case of hypnotic suggestions, thereby identifying their presence as a potential signature of hypnotic experience.

Passive Brain-Computer Interfaces for Enhanced Human-Robot Interaction.

Brain-computer interfaces (BCIs) have long been seen as control interfaces that translate changes in brain activity, produced either by means of a volitional modulation or in response to an external stimulation. However, recent trends in the BCI and neurofeedback research highlight passive monitoring of a user's brain activity in order to estimate cognitive load, attention level, perceived errors and emotions. Extraction of such higher order information from brain signals is seen as a gateway for facilitation of interaction between humans and intelligent systems. Particularly in the field of robotics, passive BCIs provide a promising channel for prediction of user's cognitive and affective state for development of a user-adaptive interaction. In this paper, we first illustrate the state of the art in passive BCI technology and then provide examples of BCI employment in human-robot interaction (HRI). We finally discuss the prospects and challenges in integration of passive BCIs in socially demanding HRI settings. This work intends to inform HRI community of the opportunities offered by passive BCI systems for enhancement of human-robot interaction while recognizing potential pitfalls.

Preliminary Validation of Japanese Version of the Parental Burnout Inventory and Its Relationship With Perfectionism.

Parenting is a precious experience and also a very hard task, which could result in parental burnout for some parents. The present study sought to validate a Japanese version of the Parental Burnout Inventory (PBI-J) by replicating and extending the pioneering work of Roskam et al. (2017). We conducted a web survey (N = 1200) to first validate the PBI-J and second to investigate the association between the PBI-J and perfectionism as a new interrelation. Similar to the prior study of Roskam et al. (2017), confirmatory factor analysis supported a model of three-factor structure of the PBI-J: emotional exhaustion, lack of personal accomplishment, and emotional distancing. In addition, we found low to moderate correlations of parental burnout with job burnout, parental stress, and depression. These findings provided initial evidence for validity of the PBI-J and suggested that parental burnout appeared to be different from job burnout. Our further evaluation of perfectionism confirmed such a difference between parental and job burnout by showing that parental perfectionism [i.e., combination of parental personal standards (PS) and parental concern over mistakes (CM)] has a unique contribution to parental burnout than does job perfectionism (i.e., combination of job PS and job CM). In addition, CM was positively correlated with burnout in both domains whereas the associations between PS and burnout were more complex. Finally, the proportion of parents experiencing burnout was estimated to lie somewhere between 4.2 and 17.3% in Japan. Overall, the present study confirmed preliminary validity of the PBI-J and found that parental perfectionism is one of the vulnerability factors in parental burnout.

Android Feedback-Based Training Modulates Sensorimotor Rhythms During Motor Imagery.

EEG-based brain computer interface (BCI) systems have demonstrated potential to assist patients with devastating motor paralysis conditions. However, there is great interest in shifting the BCI trend toward applications aimed at healthy users. Although BCI operation depends on technological factors (i.e., EEG pattern classification algorithm) and human factors (i.e., how well the person can generate good quality EEG patterns), it is the latter that is least investigated. In order to control a motor imagery-based BCI, users need to learn to modulate their sensorimotor brain rhythms by practicing motor imagery using a classical training protocol with an abstract visual feedback. In this paper, we investigate a different BCI training protocol using a human-like android robot (Geminoid HI-2) to provide realistic visual feedback. The proposed training protocol addresses deficiencies of the classical approach and takes the advantage of body-abled user capabilities. Experimental results suggest that android feedback-based BCI training improves the modulation of sensorimotor rhythms during motor imagery task. Moreover, we discuss how the influence of body ownership transfer illusion toward the android might have an effect on the modulation of event-related desynchronization/synchronization activity.

Subthalamic nucleus detects unnatural android movement.

An android, i.e., a realistic humanoid robot with human-like capabilities, may induce an uncanny feeling in human observers. The uncanny feeling about an android has two main causes: its appearance and movement. The uncanny feeling about an android increases when its appearance is almost human-like but its movement is not fully natural or comparable to human movement. Even if an android has human-like flexible joints, its slightly jerky movements cause a human observer to detect subtle unnaturalness in them. However, the neural mechanism underlying the detection of unnatural movements remains unclear. We conducted an fMRI experiment to compare the observation of an android and the observation of a human on which the android is modelled, and we found differences in the activation pattern of the brain regions that are responsible for the production of smooth and natural movement. More specifically, we found that the visual observation of the android, compared with that of the human model, caused greater activation in the subthalamic nucleus (STN). When the android's slightly jerky movements are visually observed, the STN detects their subtle unnaturalness. This finding suggests that the detection of unnatural movements is attributed to an error signal resulting from a mismatch between a visual input and an internal model for smooth movement.

The Importance of Visual Feedback Design in BCIs; from Embodiment to Motor Imagery Learning.

Brain computer interfaces (BCIs) have been developed and implemented in many areas as a new communication channel between the human brain and external devices. Despite their rapid growth and broad popularity, the inaccurate performance and cost of user-training are yet the main issues that prevent their application out of the research and clinical environment. We previously introduced a BCI system for the control of a very humanlike android that could raise a sense of embodiment and agency in the operators only by imagining a movement (motor imagery) and watching the robot perform it. Also using the same setup, we further discovered that the positive bias of subjects' performance both increased their sensation of embodiment and improved their motor imagery skills in a short period. In this work, we studied the shared mechanism between the experience of embodiment and motor imagery. We compared the trend of motor imagery learning when two groups of subjects BCI-operated different looking robots, a very humanlike android's hands and a pair of metallic gripper. Although our experiments did not show a significant change of learning between the two groups immediately during one session, the android group revealed better motor imagery skills in the follow up session when both groups repeated the task using the non-humanlike gripper. This result shows that motor imagery skills learnt during the BCI-operation of humanlike hands are more robust to time and visual feedback changes. We discuss the role of embodiment and mirror neuron system in such outcome and propose the application of androids for efficient BCI training.

Removal of proprioception by BCI raises a stronger body ownership illusion in control of a humanlike robot.

Body ownership illusions provide evidence that our sense of self is not coherent and can be extended to non-body objects. Studying about these illusions gives us practical tools to understand the brain mechanisms that underlie body recognition and the experience of self. We previously introduced an illusion of body ownership transfer (BOT) for operators of a very humanlike robot. This sensation of owning the robot's body was confirmed when operators controlled the robot either by performing the desired motion with their body (motion-control) or by employing a brain-computer interface (BCI) that translated motor imagery commands to robot movement (BCI-control). The interesting observation during BCI-control was that the illusion could be induced even with a noticeable delay in the BCI system. Temporal discrepancy has always shown critical weakening effects on body ownership illusions. However the delay-robustness of BOT during BCI-control raised a question about the interaction between the proprioceptive inputs and delayed visual feedback in agency-driven illusions. In this work, we compared the intensity of BOT illusion for operators in two conditions; motion-control and BCI-control. Our results revealed a significantly stronger BOT illusion for the case of BCI-control. This finding highlights BCI's potential in inducing stronger agency-driven illusions by building a direct communication between the brain and controlled body, and therefore removing awareness from the subject's own body.

Effect of biased feedback on motor imagery learning in BCI-teleoperation system.

Feedback design is an important issue in motor imagery BCI systems. Regardless, to date it has not been reported how feedback presentation can optimize co-adaptation between a human brain and such systems. This paper assesses the effect of realistic visual feedback on users' BCI performance and motor imagery skills. We previously developed a tele-operation system for a pair of humanlike robotic hands and showed that BCI control of such hands along with first-person perspective visual feedback of movements can arouse a sense of embodiment in the operators. In the first stage of this study, we found that the intensity of this ownership illusion was associated with feedback presentation and subjects' performance during BCI motion control. In the second stage, we probed the effect of positive and negative feedback bias on subjects' BCI performance and motor imagery skills. Although the subject specific classifier, which was set up at the beginning of experiment, detected no significant change in the subjects' online performance, evaluation of brain activity patterns revealed that subjects' self-regulation of motor imagery features improved due to a positive bias of feedback and a possible occurrence of ownership illusion. Our findings suggest that in general training protocols for BCIs, manipulation of feedback can play an important role in the optimization of subjects' motor imagery skills.

Humanlike robot hands controlled by brain activity arouse illusion of ownership in operators.

Operators of a pair of robotic hands report ownership for those hands when they hold image of a grasp motion and watch the robot perform it. We present a novel body ownership illusion that is induced by merely watching and controlling robot's motions through a brain machine interface. In past studies, body ownership illusions were induced by correlation of such sensory inputs as vision, touch and proprioception. However, in the presented illusion none of the mentioned sensations are integrated except vision. Our results show that during BMI-operation of robotic hands, the interaction between motor commands and visual feedback of the intended motions is adequate to incorporate the non-body limbs into one's own body. Our discussion focuses on the role of proprioceptive information in the mechanism of agency-driven illusions. We believe that our findings will contribute to improvement of tele-presence systems in which operators incorporate BMI-operated robots into their body representations.